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RELATIVELY EXCHANGEABLE STRUCTURES 


HARRY CRANE AND HENRY TOWSNER 


Abstract. We study random relational structures that are relatively 
exchangeable —that is, whose distributions are invariant under the auto¬ 
morphisms of a reference structure 2JI. When OT is ultrahomogeneous and 
has trivial definable closure, all random structures relatively exchange¬ 
able with respect to 9J1 satisfy a general Aldous-Hoover-type representa¬ 
tion. If dJl also satisfies the n-disjoint amalgamation property (n-DAP) 
for all n > 1, then relatively exchangeable structures have a more precise 
description whereby each component depends locally on 9JI. 


1. Introduction 

1.1. Relational structures. A signature is a finitl^ set L = {Ri ,... ,Rr} 
and, for each j < r, a, positive integer ar(Rj), called the arity of Rj. An 
C-structure is a collection 501 = {M,TZi,... ,TZr), where M is a set and 
TZj C for each j € [l,r] := {l,...,r}. We write |9Jt| := M and 

:= TZj for each j G [1, r]. In general, we write Cm to denote the set of C- 
structures Tl for which |50I| = M. Specifically, denotes T-structures with 
|91t| = N := {1,2,...} and denotes £-structures with |91t| = [n] := [l,n]. 

Every injection (j) : M' M maps Cm into Cm' in the usual way: SOI i-7> 
911'^ := {M',TZf,...,TZf) with 

(si, . . . , ■Sa,r(iJj)) G TZj \ h ((^(si), . . . , (p{SaT{Rj))) & R-j- 

We call (j) an embedding of 501''^ into 911, written (j) : 971''^ —>■ 911. In particular, 
every permutation a : M ^ M determines a relabeling of any 501 € Cm- 
When M' C M, the inclusion map, s i—>■ s, determines the restriction of 911 
by 

911|m' := (M',Ri n ... ,R^ n 

If /r is a probability measure on Cm, we write ~ ^ to denote that X is 
a random structure chosen according to yt; in this case we call X a random 
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C-structure on M. We call a pair X and of random /^-structures on M 
equal in distribution, written if lP(^|s = ©) = IP(i5|s = S) for 

every S G £ 5 , for all finite S C M. 

1.2. Relative exchangeability. Special cases of £-structures include bi¬ 
nary relations, set partitions, undirected graphs, triangle-free graphs, as well 
as composite objects, e.g., a set together with a binary relation, a pair of 
graphs, etc. We are particularly interested in random /^-structures that sat¬ 
isfy natural invariance properties with respect to the symmetries of another 
structure, of which exchangeability is a special case. 

Definition 1.1 (Exchangeability). Let /2 be a signature. A random C- 
structure X is exchangeable if X^ =x>X for all permutations cr : |X| —> |jC|. 
We also call a probability measure /r exchangeable whenever jC ~ /r is an 
exchangeable / 2 -structure. 

Given a large structure il = (fl, TZi,..., TZr) and a probability measure // 
on n, we can obtain an exchangeable random /2-structure X = (N, Ai,..., AV) 
by sampling elements </>(!), </>( 2 ),... independently and identically distributed 
(i.i.d.) from /r and then defining X = il*^. Explicit representations of ex¬ 
changeable structures are detailed in the work of de Finetti dS], Aldous [S], 
Hoover [IT], and Kallenberg [TB]. As a special case, the Aldous-Hoover 
theorem mm characterizes the exchangeable random fc-ary hypergraphs 
X = (N, A)—that is, the exchangeable random structures with a single sym¬ 
metric fc-ary relation—through the decomposition 

(1) f G A /((6)sCrngx) = 1, 

where / is Borel measurable, the random variables are i.i.d. Uniform[0,1], 
and rngx is the set of distinct elements in x. For instance, an exchangeable 
random graph can be generated by specifying a function / : [ 0 , 1]“^ —>■ { 0 , 1} 
with /(•, b, c, •) = /(•, c, b, •), selecting independent Uniform[0,1] parameters 
^ 0 , for each i G N, and C{i,j} for each pair i < j, and including the edge 
{i,j} exactly when 

= 1 - 

Exchangeable structures not only play a fundamental role in probability 
theory mm, Bayesian inference m, and applications in population genetics 
m but also have a natural place in the study of homogeneous structures 
in combinatorics [23| and mathematical logic HD. In many applications, 
e.g., spin-glass models in statistical physics [ 8 | and combinatorial stochastic 
processes [9ll24| . a random structure X is only invariant under relabeling by 
permutations that fix certain substructures of a reference object leading 
to our notion of relative exchangeability. 

Definition 1.2 (Relative exchangeability). Let C,C' be signatures and 
Xft be an /1-structure. A random £'-gtructure X is called relatively ex¬ 
changeable with respect to Tl, alternatively exchangeable relative to Xft or 
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"^-exchangeable, if X|y=x>X |5 for all embeddings (j) : 9K|5 —)■ 9Jt|T with 
(S', T C |9JI| finite. 

Remark 1.3. Relative exchangeability requires more than invariance of X 
with respect to the automorphisms of 501; it requires that when S and T 
are isomorphic substructures, the marginal distributions of X |5 and X|t are 
the same. This means that the marginal distribution of substructures X\t 
depends only on the symmetries of the associated substructure ^\t- In 
particular, (/> : N —>■ N may be an injection that is not an automorphism of 
5U1 but whose domain restriction f T : T —>■ T' is an embedding TI\t — >■ 9JI. 
In this case, 5 OT'^|t = = ^\t and X^\t = X|^r=pX|T. 

Remark 1.4. The distinction noted in Remark 11.31 does not factor into 
our main discussion. Since we always assume 501 is ultrahomogeneous (see 
coming paragraphs and Definition I2.13|) , Definition 11.21 is equivalent to the 
apparently weaker requirement that X is invariant with respect to the auto¬ 
morphisms of 911. In general, the stronger condition of Definition 11.21 is more 
relevant in many statistical and probabilistic contexts, and its equivalence 
to the weaker form is useful in our proofs. 

Remark 1.5. The classical definition of exchangeability corresponds to rel¬ 
ative exchangeability with T = 0. 

The notion of relative exchangeability is most interesting when 911 has 
many partial automorphisms. One natural condition to place on 501 is trivial 
(group-theoretic) definable closure fDefinition 15.11) . which says that, for any 
finite subset s and any a ^ s, there are automorphisms (/> of 911 that fix every 
element of s but for which 4>{a) a. Ackerman, Freer & Patel [1] have 
previously shown that structures 501 with trivial definable closure are exactly 
those for which there is an exchangeable probability measure concentrated 
on the class of structures isomorphic to 501. 

In this paper we will consider the case where 501 has an additional prop¬ 
erty, ultrahomogeneity (Definition I2.13P , which says that every finite partial 
automorphism extends to a full automorphism. Ultrahomogeneity is a nat¬ 
ural assumption in our intended application of relative exchangeability to 
Markov processes in spaces of countable relational structures HU. In that 
setting, we often deal with ensembles of structures, not all of which are 
ultrahomogeneous but so that the ensemble embeds into a common ultraho¬ 
mogeneous structure in a suitable way. Together, these properties imply a 
strong representation for X, with each piece of X depending locally on 501, 
as we make precise in Theorem 13.21 

1.3. Main theorems. Above all we seek analogs of the Aldous-Hoover 
theorem for relatively exchangeable structures. A formal description of our 
main theorems requires several technical conditions, which we defer until 
later. For now we settle for an overview. 
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Our most general result gives a representation for all random structures 
that are exchangeable relative to with trivial definable closure and ultra¬ 
homogeneity. We use the main theorem in [1] to prove the generic Aldous- 
Hoover-type representation for any 9Jt-exchangeable structure when fUt is 
ultrahomogeneous (Definition I2.1.S|) . We can, however, refine the generic 
Aldous-Hoover representation when satishes stronger properties. 

In the more general setting of Theorem 13.151 we show that each 
depends on the entire initial substructure 9?t|[i,maxx|- Under the additional 
assumption that satisfies the n-disjoint amalgamation property for all 
n > 1 (Definition 12.151) . Theorem 13.21 gives a stronger representation which 
describes ^\rngx terms of TUlmgx random variables similar to those in 
the usual Aldous-Hoover TheorerrO. The n-disjoint amalgamation property 
is a finite amalgamation property that ensures any consistent collection of 
substructures can be embedded into some other substructure of 911. 

In the classical theory of exchangeability laiaiiT!, dissociated structures 
play a key role as extreme points in the space of exchangeable random 
objects. 

Definition 1.6 (Dissociated random structures). A random T-structure X 
is dissociated if X |5 and X\t are independent for all disjoint subsets S,T C 
|X|. 

In particular, exchangeable processes can be decomposed into an average 
over a family of dissociated processes. We show that a similar decomposition 
exists for 9Jl-exchangeable processes when 911 is sufficiently nice. 

1.4. Connections to the literature. Our main theorems extend represen¬ 
tations of exchangeable structures to the more general setting of relatively 
exchangeable structures. Relatively exchangeable structures naturally ap¬ 
pear when one considers dependent sequences of exchangeable structures, 
as in the study of combinatorial Markov processes [21]. Such processes 
serve as models in a wide range of applications, some mentioned above, and 
so are of interest on their own. These considerations invoke certain other 
technicalities from stochastic process theory, which we leave to the more 
probability-focused companion paper [Hi- 

Prior work of Diaconis & Janson m highlights the connection (via the 
Aldous-Hoover theorem) between exchangeable random graphs and the Lovasz- 
Szegedy theory of graph limits [2T]. The extension of Aldous-Hoover to 
exchangeable T-structures (Theorem 12.81) makes plain the analogous con¬ 
nection between exchangeable T-structures and the generalization of graph 
limits to T-structures [7|. 

1.5. Notation. We adopt the following notational conventions: C and CJ 
always denote signatures. In general, we use fraktur letters (9Jl, 91, S, T) 

similar result has been independently shown by Ackerman [1] using a different 
argument which applies to a slightly different class of structures. 
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to denote structures. The base set is indicated by plain Roman letters (M, 

N, S, T). 

For X = (xi,...,Xfc), we write vngx = {xi,... ,Xk} to denote the set 
of distinct elements in x and we write y C x to denote that y occurs as 
a subsequence of x, that is, y = (xpj,... ,Xp^) for an increasing sequence 
Pi < ■ ■ ■ < Pm- 

1.6. Outline. We organize the rest of the paper as follows. In Section[2]we 
describe the known results about exchangeable structures and Fraisse classes, 
which we need in the rest of the paper; we also provide context for the results 
that follow. In Section [3] we describe two of our main results, a weaker 
representation whenever 9JI is ultrahomogeneous, and a stronger one when 
9JI also has n-DAP for all n. In Section 0] we prove these results, giving an 
Aldous-Hoover type theorem for relatively exchangeable structures. Along 
the way we provide several illustrative examples that should build intuition 
for how the assumed properties of 971 play a role in our representation. 

2. Exchangeable Structures 

Before proving our main theorems about random T-structures, we first 
review some known results. Throughout the paper, we equip with the 
product-discrete topology induced by the ultrametric 

d(9JI,9JI') := l/max{n G N : 9Jt|[„] / 97l'|[„]}, 971,971' G Tn, 

under which is compact. Equipping with the corresponding Borel 
cr-field allows us to ignore measure-theoretic technicalities to every extent 
possible. 

2.1. The Aldous—Hoover Theorem. The Aldous-Hoover theorem has 
been generalized to exchangeable structures other than hypergraphs, e.g., 
[zmaiiB], including asymmetric or reflexive relations. These considerations 
introduce some (mostly notational) complications to the representation in 
©• One approach, taken in [3II5], is to break a single relation into several 
correlated relations. For instance, a binary relation TZ consists of a unary 
relation {x \ {x, x) G TZ} and four binary relations corresponding to the four 
possible cases for a pair {x,y). Here we adopt a more uniform approach by 
including a random ordering in addition to Uniform[0,1] random variables. 

Definition 2.1. When s is a finite set, by a uniform random ordering of 
s, we mean an ordering -<s of s chosen uniformly at random. Given ^rngxj 
we write -<^ for the ordering of [1, | rngx|] induced by i j if and only if 
Xi ~<rngx Xj. If Xi = Xj, then i j and j i. 

Remark 2.2. Note that is an ordering of the set s, and whenever x 
is a sequence of elements from s, we use to induce an ordering -<^ of 
[1,1 rngx|]. The important feature is that when x and y are different order¬ 
ings of s, -<^ and -<g are distinct but related orderings. 
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For example, for x = (xi,...,Xfc) and a : [A:] —>■ [k] a permutation, we 
observe that 

cr{i) a{j), 

where ax := ,..., In particular, -<(x,y) is always the opposite 

ol ~^(y,x)- 


Definition 2.3. Let C = {-Ri, ..., Rr} be a language so that each Rj has 
ar{Ri) < k and let be Borel functions. The exchangeable struc¬ 

ture generated by fi,..., fr is the structure X* = (N, Rf ,..., Rf ) given 
by choosing (6)sCN:L|<fc i-i.d. Uniform[0,1] and {~<s)scn:\s\<k independent 
uniform random orderings and putting 


Remark 2.4. We usually omit when | rngy| < 1 because such an order¬ 
ing is trivial. 


Remark 2.5. For definiteness, we assume arguments are listed in some 
fixed order—say, lexicographical order of subsequences of x. For instance, 
when we write fi{{(s)sc{x,y}, i~<y)yQix,y)), we mean 

’ ^{y} ’ ^{x:,y} ’ ~^{x,y) ) • 

Similarly, when we write fi{{is)s'z{x,y,z}, {-<y)yc{x,y,z)), we mean 

/* (?0) ^{a:}) ^{y} > ) ^{x,z }) ^{y,z }) C{x,y,z }) ~^{x,y) i ~^{x,z) i ~^(y,z )) ~^{x,y,z )) ■ 

Remark 2.6. The presence of the -<g allows us to communicate between 
different orderings of s without giving precedence to some extrinsic ordering 
(like the ordering < on N). For instance, if R is a binary relation, then 

(1,2) €R^ /(C0,?{l}j'^{2})‘^{l,2}, ^(1,2)) = 1 

while 

(2, 1)gR^ /(?0>?{1}5?{2}>?{1,2})-<(2,1)) = 1- 

Since ^( 1 , 2 ) is always the opposite of ^( 2 , 1)5 these may have different values. 
Similarly, 

(1,1)gR^ /(?0,^{i},-<(1,1)) = 1, 

where -<( 1 , 1 ) is necessarily an empty ordering. 

Note that when s C s', -<s and -<si are not correlated. In particular, -Kg/ 
need not extend 


Remark 2.7. This representation is somewhat redundant: instead of encod¬ 
ing the ordering of x and y into the random ordering one could use 

and say, by determining that x -<{x,y} V if and only if < ^{y}- 

Without loss of generality, we could assume that fi is required to be symmet¬ 
ric in (Cs)<jCrngx) which would eliminate this redundancy. Since this would 
add further complications to an already involved definition for no clear ben¬ 
efit, we do not do so. 

On the other hand, we could drop the parameters {~<y)yCx entirely. We do 
not do so, because this would violate the stratification of data provided by 


RELATIVELY EXCHANGEABLE STRUCTURES 


7 


the representation. Later we need to separate the unary data, such as ^{x}) 
from the binary data, such as and -<{x,y}, and we need the asymmetry 

given by -<{x,y} to be part of the binary data. 

We can now state the Aldous-Hoover theorem in a useful general way. 

Theorem 2.8 (Aldous [5], Hoover m)- Let X be an exchangeable C-structure, 
where C, = {i?i,..., Rr}- Then there exist Borel functions fi,..., fr so that 
the exchangeable structure X* generated by fi,..., fr satisfies X =x> X*. 

We can decompose the structure X* into the structures X* given by spec¬ 
ifying = a for each a G [0,1]: 

^ '' '' /*(®) (?s)0CsCrngX) (^y)j7Ca:) !• 

Each is dissociated (Definition II.6p and, thus, Theorem 12.81 affords the 
interpretation of arbitrary exchangeable structures as mixtures of dissoci¬ 
ated exchangeable structures. For the rest of this section, we assume X is 
dissociated. 

Example 2.9. One of the simplest interesting examples of an exchangeable, 
dissociated structure is the random graph X, which is defined by putting an 
edge between each pair (re, rre) according to the outcome of independent fair 
coin flips. In terms of the Aldous-Hoover theorem, the function / can be 
chosen so that it depends only on the f,{x,y} component. The random graph 
is a standard example of an important family of structures—the Fraisse 
limits —which play a key role in our general theory; see Sections [3] and 01 

Example 2.10. An example illustrating what happens in the case of asym¬ 
metric relations is the random tournament. Recall that a tournament is 
a total directed graph such that between any two vertices there is exactly 
one directed edge. The random tournament depends only on the uniform 
random ordering -<(^x,y)i where the edge points from a: to y if and only if 
® ~^{x,y} U- 

Any probability measure /r on induces a probability measure Hn on 
^[n] by 

:= him G = ©}), © G £[„] • 

Define the support of p as the set of finite structures for which is positive: 
support(/r) : = U {© G £[„] : hn{&) > 0}. 

n>l 

Since there are countably many finite subsets of N, every finite substructure 
of T ~ /i is isomorphic to a structure in support(//) with probability 1. That 
is, the age of X is, with probability 1, contained in the support of p. 

Definition 2.11. The age of 9Jt, denoted age(97t), is the set of all finite 
£-structures embedded in 9Jl. That is, 

age(9Jt) := {S G [J C[n] ■ Tii&,XK) is non-empty}, 
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where 

H(S,9Jl) := {embeddings (/> : S —)■ 971} 
is the set of embeddings of S in 971. 

(Note that the usual definition of age(97t) includes all finite substructures 
of 971, perhaps identified if they are isomorphic. It is convenient for our 
purposes to specify the universe of our structures precisely as [1, n]. Among 
other features, this ensures that structures in the age are canonically or¬ 
dered.) 

If //n(6) > 0, then exchangeability and dissociation of X imply that, 
with probability 1, there exists a finite set S so that X |5 is isomorphic to 
S. (In fact, such sets occur with frequency Hn{&) with probability 1.) In 
the exchangeable and dissociated case, age(jC) and support(/z) coincide with 
probability 1. In particular, there is a unique collection of finite structures 
determined by fi such that, with probability 1, age(X) is equal to this col¬ 
lection. 

Since X is dissociated, age(X) also satisfies the joint embedding property 
with probability 1. 

Definition 2.12. A collection of finite structures K has the joint embedding 
property (JEP) if for all &,‘Z € K there exists ii € K such that © and T 
are embedded in 11. 

Our main theorems require 971 to have additional properties. 

Definition 2.13 (Ultrahomogeneity). An £-structure 971 is ultrahomoge- 
neous if every embedding (/> : 91 — 971, with |9I| C |97t| finite, extends to an 
automorphism </> : 971 —>■ 971. 

The following establishes the equivalence between our definition of relative 
exchangeabiity and its weaker form (see (ii) below). By Proposition 12.14] our 
main theorems immediately generalize to this case. 

Proposition 2.14. Let 971 be ultrahomogeneous and let X be a random L'- 
strueture. The following are equivalent. 

(i) X is relatively exchangeable with respect to 971 as in Definition M.iA 

(ii) X^ =x> X for every automorphism cr : 971 —>■ 97T. 

Proof. That (i) implies (ii) is automatic. In the reverse direction, suppose 
X satisfies (ii) and let <)) : 5 —T be an embedding 97t|5 —971. Since 
971 is ultrahomogeneous, there is an automorphism (/> : 971 ^ 971 such that 
^ \ S = (p. By (ii), X^ =vX and, in particular, X^\s' =vX\s' for all finite 
S' C N. Since cp extends (p, it follows that X\s =v establishing 

(i). □ 

Suppose that X is ultrahomogeneous with probability 1. A standard back- 
and-forth argument shows that there is a single structure 971 (up to isomor¬ 
phism) such that, with probability 1, X is isomorphic to 971, and [H Theorem 
1.1] implies that age(X) exhibits disjoint amalgamation. 
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Definition 2.15 (Disjoint amalgamation). A collection of finite structures 
K has the disjoint amalgamation propert'^ (DAP) if for any S,T, T' G K 
and embeddings cj) : & ^ % and </>':©—)> T' there exists a structure il € K 
and embeddings : T — )■ il and ijj' : T' ^ ii such that ij; o cp = ip' o cj)' and 
o (p) = im('0) n im(i/^'), where im((/)) := {t G |T| : 3s G |S| {(p{s) = t)} 
is the image of cp. We often abuse the terminology slightly and say has 
DAP when age (911) has DAP. 

Disjoint amalgamation implies that any pair of structures T, T' can be 
amalgamated into a larger structure without identifying any elements that 
are not already identified. In the presence of ultrahomogeneity together with 
our restriction to languages with only relation symbols, disjoint amalgama¬ 
tion is equivalent to the trivial definable closure property mentioned in the 
introduction. For our purposes, DAP is the more useful characterization to 
work with. 

Ackerman, Freer & Patel [U Corollary 1.3] show that ultrahomogeneity 
and the disjoint amalgamation property for imply the existence of an 
exchangeable random structure that is almost surely isomorphic to 9Jt. 

Theorem 2.16 (Ackerman, Freer &: Patel [1]). Suppose 9JI is ultrahomoge- 
neous and age{d}l) satisfies the disjoint amalgamation property. Then there 
is a dissociated, exchangeable random structure X such that X is isomorphic 
to Tl with probability 1. Moreover, there exist Borel functions /i,...,/^ 
such that X can be generated as the exchangeable structure of the form 

( 2 ) X & Rf < -> fi{^xi, ■ ■ ■ 

for {f,x)xeN i.i.d. Uniform[0,l] random variables. 

2.2. n-DAP. Our strongest results require an amalgamation property for 
all re > 1 simultaneously. 

Definition 2.17. Let A be a collection of finite structures that is closed 
under isomorphism. For re > 1, we say that K satisfies the n-disjoint amal¬ 
gamation property (re-DAP) if for every collection {&i)i<i<n of structures 
satisfying ©j G K, |6i| = [re] \ {i}, and <3i|[n]\{ij} = for all 

^ < i, j < n there exists © G A with |©| = [re] such that ©|[„]y{j}. = ©j for 
every 1 < i < re. Again, we say Xft has re-DAP when age(5[)l) does. 

Under re-disjoint amalgamation, if we specify a structure on each proper 
subset of [re] in a way that is pairwise compatible, then there is a way to 
unify these structures into a single structure on all of re. By slight abuse of 
terminology, if A is a collection of finite structures not closed under isomor¬ 
phism (like age(5[)l) as defined above), we say A has re-DAP if the closure 
of A under isomorphism has re-DAP. When A is closed under substructures 
(as all our classes will be), 2-DAP is equivalent to DAP. 

^This is often called the strong amalgamation property, as in [4]. We follow the authors 
who prefer “disjoint” on the grounds that “strong” is an overused adjective. 
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There is a simpler condition on the theory T which implies n-DAP for all 
n > 1 and is satisfied by the most common examples. 

Definition 2.18 (Parametric universal theories). T is a parametric univer¬ 
sal theory if each sentence in T has the form 

Vxi,..., Xk ) • • •) 

where (p is quantifier-free and every atomic formula in p contains all k vari¬ 
ables Xl, . . . , Xk- 

Lemma 2.19. If T is a parametric universal theory with models of every 
finite size and K is the set of finite models ofT then K satisfies n-DAP for 
all n > 1. 

Proof. Consider some n and suppose that for each i we have &i with |©i| = 
[n] \ {i} so that Si|[n]\{ij} = for 1 < i,j < n. We define a 

structure & on [l,n]. For any tuple x such that fewer than n elements 
appear in x, choose i not appearing in x and set x € if and only if 
X G Rf.\ Note that this definition does not depend on our choice of i, since 
if j also does not appear in x then rngx C [n] \ {i, j}, so x G R^' if and only 
if T G R^^. 

We then choose an arbitrary structure T in iF of size n; without loss 
of generality, we assume |T| = [n]. For each sequence x containing all n 
elements of [n], we set x G Rf if and only if x € R^. 

Consider some axiom Vxi,..., Xk4>{xi ,..., Xk) from T. For any /c-tuple 
X = xi,..., Xk, if fewer than n distinct elements appear in x then x is 
contained in the universe of some ©i, and the axiom is satisfied because it is 
satisfied for each ©j. If x contains all n elements then every atomic formula 
in (p contains all n elements, so the axiom is satisfied because it is satisfied 
in T. 

□ 

Example 2.20. Graphs and hypergraphs are specified by parametric uni¬ 
versal theories but equivalence relations are not. In general, a graph 9II 
consists of a single binary relation satisfying the empty theory, which is 
trivially parametric. If self-loops are forbidden, then SOI is anti-reflexive: 

(3) SOI 1= Vx (x, x) ^ i?. 

An undirected graph SOI satisfies the further symmetry property 

(4) Tl^yx,y{{x,y) G R^ {y,x) G R). 

Both (l3|) and ([1|) are parametric universal sentences because ([3]) consists of 
a single atomic sentence and (jH) can be written as 

Vx, y ((x, y) G RA {y, x) G R) V ((x, y) ^ R A {y, x) ^ R). 

On the other hand, an equivalence relation SOI is a binary relation 
that satisfies the transitivity axiom 

(5) SOI 1= Vx, y, z ((x, y) G R A {y, z) G R) ^ (x, z) G R, 
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which consists of the three atomic sentences 

(x, y) € R, {y, z) G i?, and (x, z) € i?, 

none containing all the variables x, y, z. Furthermore, the class of finite 
equivalence relations does not satisfy n-DAP for all n > 3. Let K be the 
set of all finite equivalence relations. Take re = 3 and define each ©j by its 
equivalence classes Cl/C' 2 /•••: ©1 = {2}/{3}, ©2 = {1,3}, and ©3 = {1,2}. 
Then 6il[n]\{ij} = ®il[n]\{ij} foi' * and j but there is no equivalence 
relation © of [re] such that ©|[„]\|j}. = ©j for every i = 1, 2, 3. 


3. Summary of Results 

Our main theorems generalize Aldous-Hoover and related results to char¬ 
acterize the probability law of random structures X that are relatively ex¬ 
changeable with respect to a structure 911 with trivial definable closure and 
ultrahomogeneity. Stronger assumptions about the structure of 911 elicit a 
stronger representation for X. 


3.1. The Strongest Representation. The notion of an exchangeable struc¬ 
ture generated by functions generalizes to 911-exchangeable structures. 


Definition 3.1. Let L = {Qi,---,Qr} and C! = {Ri,...,Rr’} be lan¬ 
guages so that each Ri has ar(i?j) < k and let be Borel func¬ 

tions. The dJl-exchangeable structure generated by fi,..., fr' is the structure 
X* = (N,Rf*,...,R^,*) given by choosing ( 6 )sCN:L|<fc i^.d. Uniform[0,1] 
and (^s)sCN:h|<fc independent uniform random orderings and putting 


X G Uj 


JI •■irng 1 : 




We obtain the following generalization of the de Finetti-Aldous-Hoover 
theorem to arbitrary relatively exchangeable structures. 


Theorem 3.2. Let £, £' be signatures and Tl be a countable C-structure 
that is ultrahomogeneous and has n-DAP for all n > 1. Without loss of 
generality, assume |911| = N. 

Let Cf = {i?i, ..., Rr'} have ar(Rj) < k for all 1 < i < r'. Suppose X 
is a random C'-structure that is relatively exchangeable with respect to 911. 
Then there exist Borel functions fi,..., fj-/ such that X =x) X*, where X* is 
the iM-exchangeable structure generated by fi,...,fr'- 


Lemma 3.3. If, in the situation of Theorem \S.A X is also dissociated, then 
fi,..., fri can be chosen so that the fi do not depend on ^ 0 . 

We will prove these in Section 14.31 


Remark 3.4. If £ is the empty language and C! consists of a single /c-ary 
relation, then Theorem 13.21 specializes to de Finetti’s theorem |15| (when 
A; = 1) and the Aldous-Hoover theorem [SlUTj (when A; > 1). 
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Remark 3.5. By the same argument, the analogous statement would hold if 
we replace X with a Borel-valued structure—that is, if each Rf is a function 
from to some Borel space The analogous statement would then give 
a representation where fi,..., fj.' are Borel-measurable functions so 


(®) /i('^|rng3;) (Cs)sCrng3;) i^y'jyQx') • 


The case where we consider structures is precisely the case where each flj = 

{ 0 , 1 }. 


The main outcome of Theorem E2] is that when Xft is ultrahomogeneous 
and has n-DAP for all n > 1, an SOl-exchangeable structure X can be gen¬ 
erated so that, for every subset S' C N, depends only on the smallest 
non-trivial substructure of namely SOlls- Some examples show how the 
representation depends on these assumptions. Theorem 13.151 covers the case 
where n-DAP for all n > 1 is relaxed to 2-DAP. 


Example 3.6. Suppose 911 and X are both subsets of N—that is, C and 
C each contain a single unary relation—and 911 = (N,P) is a model with 
■p C N inhnite and coinfinite. If S', T are finite subsets of N, an embedding 
(p : S ^ T that preserves 911 must map S' fl P to T D P and S' \ P to T \ P. 
Thus, an 911-exchangeable X can be viewed as two separate exchangeable 
structures—one on P and one on N \P. 

Theorem E 2 ] says that X = (N, A) can be represented by 

(6) neA ^ fm\{n},C9,C{n}) = h 

for i.i.d. Uniform[0,1] random variables j?©; (C{n})n>i}- Thus, the event 
n G A depends on three things: a global random variable ^ 0 , a random 
variable specific to n, and whether or not n € P. 

The natural way to interpret ([ 6 ]) is that we have a probability measure 
0 on [0,1]^ from which we choose Given (0o,^i), we determine A 

by independently flipping a coin for each n: if n G P, we flip a coin with 
probability 9i of landing heads; otherwise, we flip a coin with probability 
6 q of landing heads. The random variable ^0 corresponds to the choice of 
{ 6 q, 61 ), 911|{„}. determines which coin to flip for each n, and determines 
the outcome of the coin flip associated to n. The representation of this 
special case has been shown before by one of the authors [Ill- 

Note that X is not (necessarily) dissociated—n G A and n' G A are not 
independent since both depend on the same random choice of { 60 , Oi )—and 
so / depends non-trivially on ^ 0 . 

Example 3.7. Suppose C and C each contain a single binary relation and 
911 = (N,P) is a copy of the random graph (i.e., the unique up to iso¬ 
morphism universal ultrahomogeneous countable graph). If X = (N, A) is 
9Jl-exchangeable, Theorem 13.21 gives a representation 

(n,Tn) G A ^(n,m)) 1- 
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The next two examples fail n-DAP and illustrate why we cannot drop 
that requirement from the statement of the theorem. 

Example 3.8. Let C contain a single 3-ary relation and C! = {5} contain 
a single binary relation. Let Tl = (N,TZ) be an ^-structure such that for 
each i, TZ{i) = {{j,k) \ {i,j,k) € TZ} is an equivalence relation with exactly 
three equivalence classes, two infinite and the third consisting only of i. We 
generate a random T'-gtructure as follows. For each i € N, we pick one of 
the two non-singleton equivalence classes of TZ{i) uniformly at random; let 
C N be this equivalence class. We then put 

ii,j)eS^ ^ jeB*\ 

By construction, X is 9Jt-exchangeable and dissociated. However, suppose 
we could find a representation 

(7) {i,j)€S^ = 1- 

Take a triple not in TZ; without loss of generality suppose (1,2,3) ^ TZ, so 
that 2 and 3 are in different equivalence classes of 77(1). Then we must have 
exactly one of (1,2) and (1,3) in S^. With probability 1/2, ^(i, 2 )=^(i, 3 )- 
But since = 9?t|{i_3}, so representation ([7|) implies (1,2) G and 

(1,3) G are conditionally independent given and ^(i, 2 )=~^(i, 3 )- 
particular, if there is a non-zero probability that (1,2) G then there is a 
non-zero probability that both (1,2) and (1,3) are in S^. 

Notice that 971 does not have 3-DAP: suppose we try to build a structure 
containing four elements {1, 2,3,4} so (1, 2,3), (1, 2,4) G 77 but (1,3,4) 0 77. 
The restriction to each three element subset gives an element of age (971), but 
they are incompatible as a four element subset. 

The next example fails n-DAP despite having no definable equivalence 
relation^: 

Example 3.9. Let Cq consist of a single binary relation Rq. Let 971o be 
the To-structure which interprets Rq as the random graph. Let £ consist 
of a single 3-ary relation R, and let R^ consist of those triples {x, y, z) 
of distinct elements such that \R^° n [{x,y,zY\^\ is odd. 971 is clearly an 
undirected hypergraph, and it can be checked that it is universal subject 
to the constraint that when {w, x, y, z} are distinct, n [{re, x, y, 2:}]^| is 
even. In particular, 971 is ultrahomogeneous, but fails to have 4-DAP. 

Let CJ consist of a single binary relation S. We begin by defining an 
971o-exchangeable £'-structure X: for each vertex x, we choose G {0,1} 
i.i.d. We define {x, y) G if either ^ and (x, y) G 7?^° or = Cy 
and {x,y) 0 Notice that X is dissociated. 

^The underlying model-theoretic example is a structure without n-DAP which is a 
reduct of a structure with n-DAP. We thank A. Kruckman for calling our attention to 
this example from MaePherson |22| . 
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Then X is actually 9Jl-exchangeable. To see this, suppose (j) : —)■ 9Jt|T 

is an isomorphism. Then and induce two graphs on T; write 

E for the symmetric difference—that is, E is those edges {x,y) G [T]^ such 
that either (x, y) G but ((/>“^(x), (j>~^{y)) ^ or vice versa. Since 9Jt|5 
and are isomorphic, for every triple {x, y, z} C T of distinct elements, 
\E n [{x,y,z}]^| must be even. Choose any vertex v € T and let V be the 
set containing every vertex which is not adjacent to x in .E (including v). 
Then V intersects every edge in E exactly once: if (x, y) ^ E then either 
exactly one of these vertices is v, or the triple {v, x, y} has an even number 
of edges, so (x, y) is one and either (x, x) or (x, y) is the other, so exactly 
one of X and y belongs to V. But now we see that for any choice of values 
giving us a structure Xjg, by flipping the values on those x G F, we get 
the same structure on X\t- This shows that X is XR-exchangeable. 

But suppose we could represent X in the form 

(bj) S ^ {* j}’ ,i)) 

Since 9K restricted to a pair is trivial, this really has the form 

(bj) ^ S < > /('^{i})‘^{j}) ,j}) j)) 1- 

Then X must be fully exchangeable. But this is not the case; for instance, 
if {x,y,z) G then |5^ fl [{x,y, z}]^! is even while if {x,y,z) 0 then 
15-^ n [{x, y, z}]^\ is odd (consider the four possible values of + Cz by 

cases). 

3.2. Age Indexed Processes. Part of our motivation for considering ul- 
trahomogeneous with disjoint amalgamation is that these structures have 
a nice universality property: if Tl is a countable structure with age(f)T) C 
age(9Jt) then there is an embedding of into 

For any & G age(9Jt) with |©| = [n], there is a natural embedding /96,an ^ 
S —>■ XR obtained by successively choosing pe,OT(*) = where m* is least 
so that pe.OT ( H is an embedding 6|[j] — )■ XR for every 1 < i < n. (Here 
we use the fact that we have defined age(XR) to contain only structures with 
universe [n] for some n.) 

If X is XR-exchangeable, it induces a family of finite random structures as 
follows. 

Definition 3.10 (Age indexed random structures). Let C,C' be signatures, 
XR G Tn be ultrahomogeneous and satisfy DAP, and S G age(XR). Suppose 
that for each S G age(XR) we have a random £'-gtructure on |6| such 
that whenever T is an embedding, X® =x>(X^)'^. Then we call 

{X®} 6 gage (an) an age indexed random C'-structure. 

When X is an XR-exchangeable T'-gtructure, we define a random 
structure X® = where ^ Tl is the natural embedding 

defined above. That is, each X® is the finite random T'-gtructure induced 
by the image of © in XR. 
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In light of the following proposition, we call {ll£'^}6Gage(3[K) the age indexed 
random C-structure induced by X. 

Proposition 3.11. Let X be Xfl-exchangeable, ©,T G age{Xfl), and 4> : & ^ 

T be any embedding. Then 

je® =v{X^f. 

Proof. Let &,% G age(97t), pe,WiP‘x,dn be the natural embeddings dehned 
above, and assume (/> : © —> T is an embedding. Then p%^^ o cf : & ^ Tl is 
also an embedding and 

X® =v X|s =v =p(x^)'^. 

The proof is complete. □ 

Conversely, whenever {X®}ega,ge(sm) is an age indexed random structure, 
we can construct an 501-exchangeable random TLgtructure sequentially through 
its hnite restrictions (X|[„])n>o: We hrst choose X|[o] according to 
and, given T|[„], we choose according to conditioned on 

X^\^ri+i] Ij^j = T|[„]. The upshot of Theorem 13.151 is that this construction is 
always possible for 5Ul-exchangeable structures, as long as 9K is ultrahomo- 
geneous and has 2-DAP. We prove this by hrst constructing a potential age 
indexed structure. 

Definition 3.12 (Potential age indexed structures). Let fi,..., fr' be Borel 
functions and 5Ut be an ^-structure. The potential age indexed structure gen¬ 
erated by fi,...Jr' is the process {X® }eeage(OT) given by choosing (6 )sCN: \s\<k 
i.i.d. Uniform[0,1] and (^s)scN: |s|<fc independent uniform random orderings 
and setting for any © G age{XH) 

X G '' '' (^s)sCrng3;) • 

We call this a “potential” age indexed structure because it need not satisfy 
the invariance property of an age indexed structure. 

Definition 3.13. We call age compatible if the potential age 

indexed structure generated hy fi,..., fr' is an age indexed structure. 

Note that age symmetry is a property of the sequence of functions collectively— 
it is possible for fi and /2 to be individually age compatible, but (/i,/ 2 ) 
is not. When fi,..., fj./ are age compatible, the function fj that maps the 
tuples ('^s)sCN: |s|<fc) (~^s)sCN: |s|<A; to a value does depend on the labeling of 
©, but its distribution does not, as the following example illustrates. 

Example 3.14. A typical example that illustrates this is the age indexed 
structure corresponding to Example 13.81 In this example, recall that C has 
a single 3-ary relation and 971 has the property that for each i, TZ{i) = 

{{j, k) I {i,j, k) G TZ} is an equivalence relation with two infinite equivalence 
classes, while C! has a single binary relation S. To generate the age indexed 
process, we define /i(©|[i,max{ij}],^{i},^{i},^{ij}) as follows: we ignore 
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and and if ^{j} < 1 / 2 , we take /i(S|[i_max{ij}],C{i}) = 1 if and only 

if j is in same TZ{i) equivalence class as 1, while if > 1/2, we take 
/i(®l[i,max{ij}])?{i}) = 1 if and only if j is in a different TZ{i) equivalence 
class from 1. (To avoid trivialities when i = 1, we define /i in the analogous 
way according to whether j is in the same 7^(1) equivalence class of 2.) Note 
that ]P(/i(S|[i^rnax{ij}])?{j}) = 1 ) depends only on ©Ipj} (in this case the 
dependence is trivial, but in more complicated cases it need not be). The 
more complicated dependence on the entire initial segment ©|[i,max{i,j}] tells 
us which values of correspond to which values of the function fi. 

We can now state a more general version of our main result, which drops 
the assumption that has n-DAP for all n. We prove this in Section [4.51 

Theorem 3.15. Let L = {Qi,... , Qr} and CJ = {i?i, ..., Rr'} he signatures, 
let each Ri have ar(i7j) < k, and let Tl be a countable C-structure that is 
ultrahomogeneous and whose age has the disjoint amalgamation property. 
Without loss of generality, assume |9K| = N. 

Suppose that X is an Xfl-exchangeable C-structure. Then there exist age 
compatible Borel funetions fi,..., fr' such that T® =x> T*’® for every 6 E 
age{Tl) where T* is the age indexed structure generated by fi,..., f^.'. 

Theorem 13.151 drops the n-DAP assumption from Theorem 13.21 but now 
fj depends on the entire finite structure 6, not just on 6|rngx- The corre¬ 
sponding fUl-exchangeable structure X* can then be constructed by 





max x\ 


for j = 1,... ,r'. That is, we need to look at the entire structure up to 
maxx, not jnst the substructure indexed by rngx. 

Remark 3.16. Again, the analogous statement holds, by the same argu¬ 
ment, for Borel-valued structures. 

The representation in ([5]) yields a natnral sequential construction for rela¬ 
tively exchangeable structures X through their finite substructnres (X|[„])„>o. 
During the sequential construction, we need only keep track of the piece of 
XU we have “seen” so far, in the sense that when determining X|[„_|_i] based 
on T|[„], we need only consider 9Jl|[„_|_i]. 

Recall that our initial example of an exchangeable structure involved tak¬ 
ing a large structnre if = (D,7^i,... ,TZr) and a probability measnre p on 
Ll and sampling , f){2),... i.i.d. from p to obtain X = if'^. The analo¬ 
gous procedure for choosing an Oil-exchangeable random structure entails 
taking a large C U T'-gtructnre if = (D, Qi,..., Qt, TZi,..., TZr') and choos¬ 
ing points (/(n) E D subject to the constraint that the reduct \ C = 
(N, Qf,..., Qf) forms a model of Oil. The most natural approach is to 
choose points successively—first choose </>(0), then choose (/>(!) subject to 
the constraints induced by the choice of (?i(0), and so on. The dependence 
of fj on an entire initial segment of XU reflects this procedure. 
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The next example demonstrates that trivial definable closure (without 
ultrahomogeneity) is not suficient to obtain the representation in Theorem 

Erg 

Example 3.17. Let 501 be the directed graph with an edge {i,j) if and only if 
j is odd and j ^ i. We let X = (N, V) be a random unary relation such that, 
with probability 1/3, V is the set of even integers and, with probability 2/3, 
V contains each odd integer independently with probability 1/2. Since 911 
does not admit self-loops, individual points are indistinguishable in SOI, and 
every element has marginal probability 1/3 to appear in V. In any finite 
substructure of 911 with size larger than 2, we can distinguish the evens 
and odds, and X is clearly exchangeable under preserving the even/odd 
distinction. But X does not have the representation in Theorem 13.151 Since 
901 is trivial on singletons, the marginal representation of each point must 
have the form 

nGV /(C0,^{n}) = 1, 

implying that X must be fully exchangeable, which it is not. 

Notice here that 901 has trivial definable closure but lacks ultrahomogene¬ 
ity: every even integer can be mapped to any odd integer as singletons, but 
this embedding cannot be extended to an automorphism of 901. 

4. Relative Exchangeability 

4.1. Structure of proofs. By Proposition [2341 we immediately obtain the 
statement of Theorems 13.21 and 13.151 under the weaker condition of Proposi¬ 
tion |234](ii) . The observation in Proposition 12.141 adds clarity to our proofs 
and fosters intuition for the attained representations in our main theorems. 
The proofs of Theorems 13.21 and 13.151 involve some different technicalities 
depending on the different assumptions; however, they share a similar struc¬ 
ture that we outline here. The key ideas center on our chosen definition of 
relative exchangeability and a combination of the Aldous-Hoover theorem 
(Theorem 1221) and Theorem 12.161 

The core of the argument is the same in both cases. Since 501 has trivial 
definable closure, Theorem 12.161 guarantees the existence of an exchangeable, 
dissociated probability measure /r such that 3* ~ is isomorphic to 911 
with probability 1. By assumption, X* is distributed according to an 501- 
exchangeable probability distribution Pgjt, whose image under relabeling X* 
by fj is an 501'^-exchangeable measure P^<t . Let 911* denote the realization of 
3*, for which we know there exists a permutation a : |911| —)■ |911| such that 
911 * 0 - _ ^ Given 501*, we let j£* be an 911*-exchangeable structure from Pgrj}* 
so that the pair (501*, T*) is jointly exchangeable. We can regard the pair 
(911*, T*) as a single £ U £'-structure, which is exchangeable by construction 
and, therefore, possesses an Aldous-Hoover representation as in Theorem 
[231 

At this point, the details vary based on the additional assumptions about 
911, but the main idea is the same. Since 911 is ultrahomogeneous, then so is 
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9JI* with probability 1. Furthermore, age(9Jl*) = age(9Jl) with probability 
1. In particular, embedded in are infinitely many (and in fact a positive 
density of) copies of every structure in the age of Tl. By ultrahomogeneity, 
we can go through and sequentially choose representatives 4 >{2),... 
such that the domain restriction ip \ [n] is an embedding —>■ Tl* 

for every n > 1. Intuitively—we will make this rigorous—the distribution 
of X*^, given XU*, depends only on Tl*^ = 971 and is a copy of an 971- 
exchangeable structure. 

The remainder of the argument relies on a special form of the Aldous- 
Hoover representation in each case, which in turn determines the nature 
of our representation for T*. Under n-DAP for all n > 1, the distribution 
of 3* factors through substructures fDefinition 14.ip . while under 2-DAP the 
representation of X* is as in Q. Since Aldous-Hoover representations are 
unique up to measure-preserving transformations, we can always transform 
to get the appropriate representation. Theorem 14.81 ensures that our choice 
of embedding (p, which depends on 3* and is therefore random, does not 
affect the ensuing distribution of X*. 

We begin with a proof of Theorem 13.21 


4.2. Distributions with Enough Amalgamation. Under the assump¬ 
tion that 971 satisfies n-DAP for all n > 1, the following lemma shows that 
there is a well-behaved representation of 971, a key idea in our proof of The¬ 
orem El 


Definition 4.1. Suppose 971 is the exchangeable structure generated by 
/i ,..., /j. . We say 971 factors through substructures if there are functions /* 
so that for almost all (‘^s)scN: (^s) 5 CN: b|<A:? 


(9) 


/i((^s)sCrngX) /i({®^|s}sC;rnga:5 frngx; 


In general, the variables encode the |s|-ary information about the struc¬ 
ture 97t. When 97t factors through substructures, the only dependence /j has 
on the information of arity strictly less than | rng x\ is already realized by 
the lower arity part of the structure 971. This means that the functions fi 
have no “hidden” information: all the information in -<s is represented 
in 97t|s. 


Lemma 4.2. Suppose 971 is ultrahomogeneous and satisfies n-DAP for all n. 
Then there are Borel functions fi,..., fr so that the exchangeable structure 
971* generated by fi,fr is isomorphic to 971 with probability 1 and factors 
through substructures. 


The construction in the following proof is essentially the frame-wise uni¬ 
form measure introduced in [El; see also [20] . 

Proof. For each n, let age^(97I) be the elements of age(97I) of size n. Pick any 
Borel-measurable map S : [0,1] —)• age^(97I) such that for any 6 G age(971), 
5”^(6) has positive Lebesgue measure. Then we set /i(0,^m)^m) = 1 if 
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and only if 1 G (Recall that, by our convention, S{^rn) € age;^(9Jl) 

and therefore |5(^m)| = {!}, so we are looking at the unique point of S{^rn)-) 

Suppose we are given structures {9?l*|s}scmgx- Then (after identifying 
rngx with [1, | rngx|]) the structures &i = 5?l*|rngx\{i} satisfy the conditions 
of n-DAP. Let A C age„(9}T) be the set of amalgams and let A' be a choice 
of representatives from each isomorphism class of A. n-DAP ensures that 
A, and therefore A!^ is non-empty. Pick <S : [0,1] Al Borel-measurable 
so that for each 21 € A!, <S“^(2t) has positive measure. (This is possible 
because A! is finite.) 

The partial models {9Jl*|s}sCmgx and an amalgam 21' G A! may not be 
enough to fully specify an amalgam, because 21 ' may introduce some new 
asymmetry—that is, there may be multiple ways to amalgamate l^j^cmgS 

into an isomorphic copy of 21'. Since the automorphism group of 21' is a sub¬ 
group of the permutations of rngx, we can associate to each ^rngS some 
such amalgam 21 ^^^^- so that the association respects the automorphism 

group of 21'. Then we can set /i({9?l*|s}scrngx)?rngx) ~<x) = 1 if and only if 
21 ^ - 
f G R, 

Consider some randomly constructed built according to the functions 
fi- By definition age{Tl*) C age(9Jl), but also age(9Jt) C age(9JT*) with 
probability 1, as we now show by induction on the size of |S|. It suffices to 
show that the probability of each & occurring is positive. If S G agei(5[)I) 
then this is by dehnition. If S G age„^i(9II) and s = {si,... , 5 ^+ 1 } ^ N 
with |s| = n-|-l, with positive probability, each is isomorphic to S|{j}. 

Then, since each possible amalgam occurs with positive probability, there is 
a non-zero chance that each is isomorphic to 6 |{jj}. Continuing in 

this way, there is a non-zero chance that is isomorphic to S. Therefore, 
with probability 1, 6 G age (SOI*). 

Further, 971* is almost surely ultrahomogeneous. To see this, it suffices 
to show that for any S with |S| = n, any (p : S and any T G 

age„^;^(971*) so that 971*|5 = T'^, there is some x ^ S so that 97t*|5u{x} = 
(where px extends p by 4>x{x) = n -|- 1). First, since %\^ri+i} £ age;^(971*) = 
age^(97T), there are infinitely many x so that 971*12, is isomorphic to T|{„_|_i}. 
Since T G age (971*), is one of the possible amalgams of { 97 r|s}scsu{ 3 :}j 

so for each x there is positive probability that 971* | 5 u{x} = ■ la particular, 

with probability 1, there is some x such that 971*|5u{2,} = By a standard 
back-and-forth argument, 971 and 971* are isomorphic. □ 

Example 4.3. The natural representation of the random graph is by defin¬ 
ing /(C{i,j}) = 1 if and only if Cpj} ^ [0; 1/2]- (The structure restricted to 
singletons is trivial and can be ignored.) 

Example 4.4. The random tournament can also be expressed in this way: 
the structure restricted to a singleton is always trivial, so we define /(C{ij}, 

) = 1 if and only if i j- 
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Example 4.5. Suppose C contains a single k-ary relation R and we assume 
is symmetric and anti-reflexive (only holds for tuples containing k dis¬ 
tinct elements) and is non-trivial (contains at least one /c-tuple but not all 
/c-tuples). Then the representation in Lemma 14.21 implies that 5J1 is the ran¬ 
dom k-ary hypergraph (in particular, all A:-ary hypergraphs are embedded 
In 5J1). This is because restricted to subsets of size less than k Is trivial— 
since there are no relations of arity less than /c in T, no substructure of size 
less than k contains any instances of R —so we have x G Rp^ if and only if 
fii^x) = 1- Thus, if Ti,... are pairwise distinct tuples each consisting 
of k distinct elements, the events Xi G R!^* and {xj G \ j ^ i} are 

independent, so all k-ary hypergraphs appear with positive probability. 

We note that the existence of representations which factor through sub¬ 
structures actually characterizes ultrahomogeneous structures with n-DAP. 

Lemma 4.6. Suppose Tl is a C-structure on N and there exists a random 
C-structure 971* which factors through substructures and, with probability 1, 
is isomorphic to 971. Then 971 is ultrahomogeneous and has n-DAP for all 

n. 

Proof. The argument above shows that 971*, and therefore 971, is ultrahomo¬ 
geneous. 

To see that 971*, and therefore 971, has n-DAP for all n, we proceed Induc¬ 
tively. Consider suitable structures {&i}i<n in age(971*), and suppose we 
have already shown n — 1-DAP; in particular, we have already shown that 
there are infinitely many pairwise disjoint sets S with (/> : 5 —>■ [1, n] so that, 
for each distinct i,j G [l,n], 971*|5\{^-i(i)_^-i(j)} = 

For each i, there is a set Hj of positive measure such that if ^ 5 \{ 0 -i(i)} G 
Hi and for each j G [l,n] \ {z}, 971*then 

971*|5\{(^-i(j)} = Sf. Since the collection I * £ [I;HI is indepen¬ 

dent, and there are infinitely many choices of S, there must be some such set 
S where each G Hj, and therefore 971*I 5 is an amalgam of {&i}i<n 

in age (971*). □ 

4.3. Proof of Theorem 13.21 

Proof of Theorem \‘J.‘A We have two languages C = {Qi, ..., Qr} and C = 

{ill, • • •, Rr'}- 

Let 971 and X be given. By Lemma (4. 2 ( we can choose a random exchange¬ 
able structure 971* that with probability 1 is isomorphic to 971 and 971* factors 
through substructures. 

Since 971* is exchangeable and X Is 971*-exchangeable, we can combine 971* 
with X to obtain an exchangeable probability measure on T U T'-gtructures 
(3*,X*). By Aldous-Hoover, there exist functions gi,hj so that for (Cs)sCN 
i.i.d. Uniform[0,1] and (IZs)sCN independent uniform random orderings 

• X G Qj^ \ I' fl'i((Cs)sCrng3;) 1) 
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• X G Rj \ y ((Cs)sCrng3;) (.^y)yCx') !• 

We would like our representation of 3* to factor through substructures; 
since Aldous-Hoover representations are not quite unique, it takes some 
tedious work to make this happen, but readers may wish to take this claim 
for granted and move on to the heart of the proof. 


Claim 1. Without loss of generality, there are functions gi so that 


9i{{.Cs) sCrngX) (Cy)yCa;) 5i({3 |s}sCrngX)Ci 


rngx) '—xj 


Proof. Consider the functions vi,...,Vr generating and suppose 5U1* 
is generated from vi,... ,Vr using the i.i.d. Uniform[0,1] random variables 
(^s)sCN: |s|<fc and independent uniform random orderings (-<s)scN: |s|<A:- Be¬ 
cause the representation vi,... ,Vr factors through substructures, there are 
the corresponding functions vi,... ,Vr as in ([U]) . 

Because 971* is exchangeable and 971* = 1 ) 3 *, there is a measure-preserving 
transformation that takes the Aldous-Hoover representation of 971* to that 
of 3*, and vice versa. In this direction, we take an additional system of 
variables—(^') i.i.d. Uniform[0,1] and (^ 5 ) independent uniformly chosen 
random orderings—and we let T'^, be a family of measure-preserving 
transformations such that if we set 


Cs — T^^Ki^t)tCs, {-<y)yCx, {Ci)tCs, {-<'g)y(Zx) 

and 

we have 

sCingxj i~^y')yQ^') 9i{{Cs) sCrnga;, i.^y)yQx) 

almost surely. (That such a measure-preserving transformation exists is a 
consequence of Kallenberg [18( Theorem 7.28].) 

By the Coding Lemma [5l Lemma 2.1], we can encode the pairs of i.i.d. 
Uniform[0,1] variables by a single Uniform[0,1] random variable by 

fixing a measure-preserving function T' : [0,1] —> [0,1]^. We can further 
encode the difference between -<s and -<'g by letting Fg be the set of functions 
from permutations of [1, jsj] to itself. This gives us a Uniform[0,1] random 
variable and a measure-preserving function Cbl : [q^ 1 ] —>• [ 0 , 1 ] x [ 0 , 1 ] x , 
whose components we write as respectively. We then set 

6 = Cs = and [k|^'(^|)](^ 5 ). Note that this is “level 

preserving” in the sense that fsiCs^ -<'s depends only on for every 

s. 

We then define gj and /ij by 


9i ((^s)sCrngx, {~^C^yCx) ’7j((Cs)sCrngx, (l—y)j7Ca;) 


22 


HARRY CRANE AND HENRY TOWSNER 


where (s, Cs are obtained from (^J) and {~<s) through the natural composi¬ 
tions of the V^. 

By assumption, 9K is ultrahomogeneous and has n-DAP for all n > 1 and 
3* is exchangeable and isomorphic to with probability 1. Let 3^ be the 
structure generated by the g\ so that 3^ = 2 ? 3*- We can define functions 


Si ({3^IslsCrnga?) ^rngx’ ({3^|s}sCrnga:) " (^rngx)’ ^5?)’ 


and the functions gj show that the representation given by gj factors through 
substructures as well since 


Si ((d)sCrng3;) Si{{Cs^sCrngxt i^y'jyQx') 

^ii.i^s'jsGvngx^ i~^y')yQx') 
f’i({3^ |s}sCrnga:j ?rng xj ^x) 

~ Si ({3^|s}sCrngX) ?rngx’ 


(In passing from the second to third lines above, we once again use the 
fact that 3* factors through substructures.) Therefore 3^ factors through 
substructures and we may replace gi, hi with g \, h|. H 


For any set S' C N, we define M{{Cs}sCS, (iTs)scs) to be the £-structure S 
with |6| = S' and x G Qf if and only if gi{{^s)sCx, i^y)y<zx) = 1- Conversely, 
given 6 and (lZs)sC6) we can consider the set 

0(6, (C.)) = {{C} I M{{0}scs, i^s)scs) = 6}. 


We have chosen 9Jt* so that it factors through substructures, implying that 
0(6, (iZs)scs) is a cube, i.e., for suitable functions 0^(6, Cs) it has the form 
rises 0s(6|s,IZs) . This is because whether or not M({Cs}scs, (iTs)sCs) = 
6 depends only on M{{(t}t'Zs, (iTt)tcs) for s C 5 and the values (s, -<S- 
In particular, if 6 € age(S[)I), then there is a conditional measure on 

0s(6|s,IZs), and we may define a measure-preserving function ^ 

[0,1] —)■ 0s(6|s, Cs). We may now define 


(?s)sCrnga;) (Ey)yCa:) ^i((^. 


eu,(&hc. 


( 6 )) 


sCrnga?) (Eyjj/Ca: 


We now return to the original structure 5UI. 
generated by the fj using fUI; that is, 

X e Rf 


Let X** be the structure 


'' '' fjiP^lvngsj (^s)sCrnga;) (Ej7)yCx)' 

0bserve that for any S' C N, P(T**|s = T) is equal to P(X*|s = T | 3*|s = 
fUI|s) (that is, the conditional probability that X *|5 = T, given that 3*|s = 
9JT|s). Recall that X is OJI-exchangeable and X* is chosen to be relatively 
exchangeable with respect to 3* (and 3* is exchangeable and isomorphic to 
XU with probability 1). By our choice of X*, we have 


P(X*|s = T|3*|s = T>I|s); 


whence, X=x>X**. 


□ 
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Proof of Lemma \S.S[ Suppose that X is dissociated. Then, from the previ¬ 
ous theorem, we have the structure X** =vX generated by the fj. For any 
^ 0 , define 


fie 

•'j 


(?s)0CsCrng3;) (.^y)yCx) fji^i if,s)sCrngxi {^y)yCx)- 


For each ^ 0 , the functions /|® generate a structure We claim that for 
almost every ,^ 0 , X^® =t>X**. It suffices to show that, for each S and each 
©, for almost every ^ 0 , P(X ^®|5 = ©) = P(X **|5 = S). 

Toward a contradiction, suppose that for some S and ©, there are pos¬ 
itive measure of ,^0 such that P(X ^®|5 = ©) / P(X**|s = ©). Using the 
ultrahomogeneity of 971, we can find T with 5 fl T = 0 so that 97t|5 is 
isomorphic to 97 T|t and, therefore, so P(X^®|t = ©) = P(X ^®|5 = ©) and 
P(X**|r = ©) = P(X **|5 = ©). However, by the shared dependence of X ^°|5 
and X^o|r on the events {X**|r = ©} and {X **|5 = ©} are positively 
correlated, implying that P(X**|t = © | X **|5 = ©) > P(X**|r = ©)■ But 
this contradicts the dissociation of X**. 

□ 


4.4. Sufficiently Large Product Algebras. In this subsection we give a 
technical result showing that a Borel function / : [0,1]^ — >■ [0,1] is measur¬ 
able with respect to a smaller cr-algebra where the only sets in B are ones 
which can be defined from / in a certain way. 

Definition 4.7. Let {fj} be a countable collection of functions on [0,1]^-’. 
We say u : [0, l]'^ —>■ [— 1,1] is generated by the fj if there exists a function v, 
values ji,... ,jr, and tuples U for z < r such that 


■■■Xd) 


vifh{Ccl^---Xcl )>•• 



Theorem 4.8. Let {fj} be a countable collection of Borel-measurable func¬ 
tions on [0, l]^-’. Suppose we have fixed a measure p. on B. Then there is a 
a-algebra B such that: 

• Each fj is measurable with respect to B^T 

• B is generated by sets of the form {(^ | v{C, C 2 , ■ ■ ■, Cd) S I}, where I 
is an interval and v is generated by the fj. 

Furthermore, if for each d we have a set C B'^~^ with = 0, we 

may choose the generating sets {C | u(C) C 2 , ■ ■ ■, Cd) £ 1} so that {C 2 , ■ ■ ■ Xd) 0 

Bd-i- 


Proof. It clearly suffices to show this when the collection of function {fj} 
consists of a single fnnction / on [ 0 , 1 ]^, since if there are multiple functions, 
we can simply take the union of the corresponding cr-algebras. Without loss 
of generality, we assume the sets B^ are closed under permutations and that 
for any z, if C 0 Bd then the set of C' such that (C, C') € Bd+i has measure 0 . 

If A: = 1 this is trivial, so assume A: > 1. 
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We say a set is built from f if it has the form {(^ | v{C, ( 2 , ■ ■ ■, Cd) ^ 1} 
with V generated by /, I an interval, and (C 2 , ■ ■ ■ ,Cd) 0 Bd-i- We build B in 
countably many stages, beginning with the trivial fj-algebra Bq, with each 
stage finitely generated by sets built from /. 

Suppose we have a a-algebra B generated by finitely many sets built from 
/. We call B' a good extension of B if: 

• B<^B', 

• B' is generated by 0 U {Si,..., S^/}, where k' < k and each Sj is 
built from /, 

. ||e(/|(s')")IIl2>I|ie(/|s")IIl- 

We claim that if / is not measurable with respect to B^ then a good 
extension exists. Given B where / is not measurable with respect to B^, let 
/' = / - E(/ I B^) so 

o< y'[/'(Ci,...,a)]V- 

E(/ I B) has the form where the IljXfc ^^e rectangles 

from B^. Since each Bi^j is a finite union of finite intersections of sets built 
from /, we may expand all these unions and intersections and, without 
loss of generality, assume that Bij itself is built from /; and since Bij = 
IC I ^i,jiCXi,j) £ 1} for some Dij, we may dehne f'ij(C)Cij) to be the 
characteristic function of this set. So /'(Ci, • • • j Cfc) has the form 

/(Ci,...,a)-E^*nG'/Ci,CM). 

i j<k 

By Cauchy-Schwarz, we have 

0 < y [f'{Ci,...,Ck)?dn’^ 

= j ^[/'(Ci, • • • 

< \j J dniCi) 

= \j 11 /'(Cl,C2°•••,Cfc°)/'(Cl,C2^•••,a)d//2fe-l(<fO^^^^ 

Iterating this process for each coordinate i < k and raising to the 2^, we 
have 

In this integral, for each i € [1,A:], we have a copy of Q for each function 
r : ([ 1 , k] \ {f}) — 7 > {0,1}. Observe that if r 7 ^ r' in the product, there is at 
most one i such that —•£ £]^gj.g jg g^j^y g^gi^ ^ then 
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r(j) = T'{j) for j 7^ i\ if we also had t(z) = r'(z) then we would have r = t'. 
It is also easy to see that each Q appears exactly twice in the product. 

The important feature of this product is that each term has the form 

where each is chosen from one of copies. We have a distinguished 
choice for each i: one element of our product is ■ ■ ■, Cfc) any 

other copy of f includes at most one in its list of inputs. 

Therefore, we can rewrite this product 

o< II 

i 

separating all the other variables into . In particular, there is a set of 
of positive measure such that 

o<i ! ncl---,A- 

i 

When we expand out /' in the product Hi Ci^)i a large sum 

of products of the form 

i 

where the as in the previous equation and the ^ are the fixed parameters 
appearing in the construction of the sets in B. The level sets of this sum 
can be approximated by unions of sets of the form Hi Bi where each Bi has 
the form | ,^)}- Therefore there must be some sets Bi of this 

form so that the set of making | /j| > 0 has positive measure. 

Therefore we can choose parameters so that ) 0 B^. Taking B' 

to be the fj-algebra generated by U {Bi ,..., B^}, ||IE(/ | B')\\i 2 > ||IE(/ | 
B)\\f^ 2 . This shows the existence of good extensions. 

Let Bq be the trivial u-algebra. Given Bi, if f is not measurable with re¬ 
spect to Bf, we choose Bi^i among all good extensions of B so that whenever 
B' is a good extension of Bi, 

||E(/ I B')\\l2 - ||E(/ I B,+i)\\l2 < 2(||E(/ I B,+,)\\l2 - ||E(/ | 

(In other words, contains at least half as much information as any other 
good extension.) Let e* = ||E(/ | Bi+i)\\L 2 - ||E(/ | Bi)\\L 2 . 

We let B = Ui Bi+i- Observe that ||/||l 2 > J2i so Cj —0. In particular, 
if / were not measurable with respect to B, we could find a good extension 
B' ^ B with ||E(/ I B')\\i 2 > ||E(/ | B)\\i 2 + e. But for some i, e* < e/2, 
contradicting the choice of Bi+i. □ 
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4.5. Proof of Theorem I3.15L 

Theorem 4.9. Let T, CJ be signatures and he an ultrahomogeneous C- 
structure whose age has DAP. Suppose X = (N,Ti, ... is a dissociated 
Xfl-exchangeable C' -structure. Then there are age compatible Borel functions 
fi,..., fr' so that the age indexed C-structure {^®} generated by fi,..., f^' 
satisfies =x>X® for all & G agelXfl). 

Before giving the actual proof, we give a brief outline. As in the proof 
of Theorem 13.21 we will replace with an exchangeable representation 
and then apply Aldous-Hoover to obtain a representation (3*,T*) of the 
combined structure. After a measure-preserving transformation, we will 
ensure that the representation of Wl is “random-free”—that is, depends only 
on the singleton data Q. 

We will then apply Theorem 14.81 to decompose the singleton random vari¬ 
ables Ci into two independent random variables rji and so that rji captures 
all the information needed to construct 3*, while represents the remaining 
information in Q which is needed to construct X*. 

The representation we construct will depend on the random data Given 
the and a 6 G age(9Jl), we use S to “guess” what the values rji might 
have been: specifically, we choose a “typical” sequence of values iji which 
would have caused 3*|s = &■ Given r]i and we can reconstruct the value 
Q, which is the data needed to construct T*| 5 . 

Proof. By Ackerman-Freer-Patel [1], there is an exchangeable probability 
measure // concentrated on T-structures Tl' isomorphic to given in the 
form 

X G *' )jGrng x) • 

By assumption, there is an iUl-exchangeable measure p,' such that the re¬ 
striction of X' ^ p' to S depends only on for every S' C N. 

As sketched in Section 14.11 we can put the exchangeable structure Wl' 
and an SOlhexchangeable structure X' together to obtain an exchangeable 
probability measure on £ U T'-gtructures (3*,T*). We write XU* for the C- 
structure corresponding to 3*, which is isomorphic to Xfl with probability 1. 
By Aldous-Hoover, there exist functions gi, hj and a collection (Cs)scN: \s\<k 
of i.i.d. Uniform[0,1] random variables and (^s)scN: |s|<fc uniform random 
orderings so that 

• X G Qi '' '' 5i((Cs)sCrng3;,|s|>0) (^i7)!7Ca:)) 

• X G Rj *' ((Cs)sCrng 3 ;, |s|>0) i~^y)yQx) ^ and 

• for any H C N, the distribution of T*|i/ given that Xfl*\V = 6 is the 
same as the distribution of X‘^ . 

As in the proof of Theorem 13.21 we may apply a measure-preserving trans¬ 
formation so that our representation of 3* has the same form as p —that is, 
depends only on singletons—so we may assume without loss of generality 
that 

X G Qj '' '' &ngx) 1- 
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For any 5 C N, we define M{{Cn}nes) to be the /^-structure S with |S| = 

S and X G Qf if and only if gi{{Cj)i£vngx) = 1- We intend to use Theorem 
14.81 to choose a fi-algebra B so that each gi is measurable with respect to 
B^* and 3£*|5 is independent of B after conditioning on M{{(n}nes)- 

We write Zg^e for the event {M{{(n}nes) = ©} and for the event 

{X*|s=‘I}. 

Claim 2. Let s C N by hnite. For each n ^ s, let Vn be generated by the 
fi, let a rectangle I in [0, be given, and let 

^{C„},/({C”'}nGs) = {{CnjnGs | nf'n(Cn,C"') € /}. 

nGs 

Then the set of such that 

P(X,,x I % 4 , 7 ({r}ne.) and Zg^e) / F(r ,,5 | Zg^e) 
has measure 0 . 

Proof. The set UnGsiCn, C""} is a hnite set of random variables. We hx an enu¬ 
meration t D s of these variables so that if n 7 ^ n' then and are mutu¬ 
ally independent sets of random variables. Let = U{(Ai} fo{i)„},/({C"'}) 

be the event on {Cn}net that there is some {C”} so that Yln£t^niCn,Cn) & 

I, i.e., l^{i;„},/({C”'}) holds. The event PI Zg^Q is determined by 

M{{Cn}net) and implies that M{{Cn}net)\s = &■ Therefore, V^y^^jP^Zg^Q is 
a union of events of the form g' where ©'|s = ©. But for any such &' 
and any /iLgtructure %' with fZ'\ = t, we have 

P(W,X' I Zt,&)=n^^' =%'), 

and, since depends only on 9Jl*|s, 

nxs,%\zt,&) = n^^ = x). 

Therefore 

P(X ,,5 I F{c„},7({r}) and Zg,e) = ^ P(X,,x | Zt,&)nZt,6' \ %„},/({r}) and Zg^e) 

6 ': 6'U=e 

= P(X,,x I Zg,e) E I and Zg^e) 

6': e'\s=6 

= I Zg^e). 

H 

Choose a countable collection of functions v dense in the collection of 
functions generated by the fi and let be the union of all countably many 
sets of measure 0 given by the previous claim over all h, s, ©,T. 

By Theorem 14.81 we can choose a u-algebra B so that 

• each fi is measurable with respect to B^^ and 
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each set in ijl®! is generated by sets 

= {{CnWiel I n ^n{Cn,n € I}, 

ne|6| 


SO that any is independent of B when conditioned on M ({Cn}nG|6|) = 

6 . 


We decompose Q = h{r]i,^i), where B is measurable with respect to the 
rji component alone. For \y\ > 1, we set Cj/= Cy- 

Now, for each & with |S| = [l,n], we wish to choose a single value r/e 
(depending on the values chosen for for n' < n) so that setting 


/j (® I [maxx]) (Cs)sCrng3:) i^y)yQS!) /j ((^(^Sp J ))«Grng xj (?s)sCrnga;,|s|>l5 {^y}y^x') 


satisfies the theorem. 

It suffices to show that for any finite S, T, the set of 770 ri j • • • j ^6 fn = ^6 
such that M{{r]eii}) = & and 


P(Z,,x) / P(X® = T) 


(where the first probability is over choices of has measure 0. For then we 
choose the sequence 7?6 ri )■■■)% fn successively, avoiding the set of measure 
0 of choices for which either belong to such a set, or which cause the 
set of extensions belonging to such a set to have positive measure. 

Towards a contradiction, suppose that for some finite 6 , T, the set of 
'n6\i,---,r]&\n such that M{{r]e^i}) = G and 

nzs,%) / p(x® = T) 

has positive measure. Then there exists some set B in B^^^ so that M ({C(/>(n) ® 

for all {C< 7 >(n)} € but ¥{Zs^%) 7 ^ P(X® = T). This contradicts the con¬ 
struction of B. 

It follows that we may choose r/g by induction on |S| and set 


fm [max^]; (^s)sCrng^? ) /j((5(hSp) ?i))iGrngS) (Cs) sCrnga:,|s|>l) i^y^yGx) ■ 


□ 

Proof of Theorem \3.1^ Follows immediately from Theorem 14.91 □ 


5. Concluding remarks 

5.1. Applications to Markov chains. A natural setting for relatively 
exchangeable structures is in the study of Markov chains on combinatorial 
state spaces. A (diserete-time) Markov chain on C is a collection 
X = (Xt)t=o,i,... of random T-structures whose distribution is determined 
by an initial distribution y and a family of transition probabilities 

P{x, •) := P{Xt+i G • I (As)o<s<t, Xt = x}, X G Ah, for all t > 0. 

Given those ingredients, X is generated by Xq ~ y and, given Xt = x, 
Xt+i ~ P{x, •) for every t > 0. 
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Special cases of these processes, e.g., partition-valued processes pfTT|[2l] 
and graph-valued processes [ISIIIS], arise in various statistical applications, 
where the assumptions of exchangeability and consistency are natural. We 
call X exchangeable if := and X are versions of the same 

Markov chain for every permutation u : N ^ N; and X is consistent if the 
restriction X|j„] := (Xt|[„]) 4 =o,i,... to ^-structures with domain [n] is also a 
Markov chain for every n > 1. Relative exchangeability arises naturally in 
this context: for every t >0, the exchangeability and consistency properties 
imply that Xt+i is relatively exchangeable with respect to Xt- The consis¬ 
tency assumption is, in fact, stronger than relative exchangeability because 
it must account for variability in the reference structures Xt for every t > 0: 
the transition probabilities of X entail an ensemble of relatively exchange¬ 
able structures that fit together in an appropriate way. We consider these 
and other relevant questions about combinatorial Markov processes in the 
companion article M- 

5.2. Non-trivial definable closure. The main result in [3] actually holds 
without ultrahomogeneity under the weaker assumption of trivial (group- 
theoretic) definable closure: 

Definition 5.1 (Definable closure). Let T be a signature and 911 be an C- 
structure. For any x € N, the (group-theoretic) definable closure of x in Tl 
is defined as 

dcl 5 ij{(x) := {6 G N I g{b) = b for all automorphisms gr : 911 ^ 911 that fix x}. 
We say that 911 has trivial definable closure if dclOT(x) = rngx for all x G N. 

Our construction in Theorem [3T5l however, requires ultrahomogeneity to 
construct the functions pe- Example 1,3.171 shows that Theorem 1,3.151 does not 
hold for general 911 with trivial definable closure. On the other hand, Austin 
&: Panchenko’s [5] results for structures based in trees give representations 
when Cf is a unary language where 911 is ultrahomogeneous but fails to satisfy 
n-DAP, and in their stronger result, fails to even satisfy trivial definable 
closure. 

These raise the following questions for future consideration. 

Question 5.2. Are there representations in the style of Theorem 1,7.111 and 
Theorem 1,7.1,71 that hold when 911 has trivial definable closure but is not ul¬ 
trahomogeneous ? 

Question 5.3. Are there interesting classes of models with weaker properties 
than ultrahomogeneity and n-DAP for all n with a stronger representation 
than that in Theorem \3.15\ ? 
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